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Abstract 

The present study asks how cooperation and consequently structure can emerge in many different evo¬ 
lutionary contexts. Cooperation, here, is a persistent behavioural pattern of individual entities pooling and 
sharing resources. Examples are; individual cells forming multicellular systems whose various parts pool and 
share nutrients; pack animals pooling and sharing prey; families firms, or modern nation states pooling and 
sharing financial resources. In these examples, each atomistic decision, at a point in time, of the better-off 
entity to cooperate poses a puzzle: the better-off entity will book an immediate net loss - why should it 
cooperate? For each example, specific explanations have been put forward. Here we point out a very general 
mechanism - a sufficient null model - whereby cooperation can evolve. The mechanism is based the following 
insight: natural growth processes tend to be multiplicative. In multiplicative growth, ergodicity is broken in 
such a way that fluctuations have a net-negative effect on the time-average growth rate, although they have 
no effect on the growth rate of the ensemble average. Pooling and sharing resources reduces fluctuations, 
which leaves ensemble averages unchanged but - contrary to common perception - increases the time-average 
growth rate for each cooperator. 
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At a recent Santa Fe Institute meeting it was remarked that the most striking 
feature of human life on earth, especially of economic life, is cooperation at all imag¬ 
inable scales of organization. We would add that it is not only human life but life in 
general that displays cooperation. Life is full of structure - we living beings are not 
minimal self-reproducing chemical units, but cells, organisms, families, herds, com¬ 
panies, institutions, nation states and so on. This type of structure, some form of 
cooperation, is so widespread that we don’t often ask where it comes from. Economics 
should be the place to look for an explanation of human social structure, but oddly 
the basic message from mainstream economics seems to be that optimal, rational, 
sensible behaviour would shun cooperation. In many ways we see cooperation in the 
world despite, not because of, economic theory. 

Many economists are aware of this shortcoming of their discipline and are address¬ 
ing it, often from psychological or neurological perspectives, as well as with the help 
of agent-based evolutionary simulations. 

We show that cooperation and social structure arise from simple analytically solv¬ 
able mathematical models for economically optimal behaviour. We contend that 
where economics uses models of such simplicity it ignores essential insights of the 
last two centuries of mathematics. Specifically, economics uses inappropriate math¬ 
ematical representations of randomness. These representations have been essentially 
unchanged since the 17 th century. As a consequence effects of fluctuations and risk 
(or of dynamics and time) are not properly accounted for. 

In the following we introduce a minimal model of cooperation and analyze it using 
modern mathematical tools. This reveals an evolutionary advantage of entities that 
cooperate over those that do not. 

Let Xi{t) represent the resources of individual i at time t. For example, we could 
think of these resources as “calories,” while being mindful that we’re really exploring 
a mathematical model that will be more or less applicable to different real-world 
cases. Calories can be deployed to generate more of themselves - for instance, a tired 
starving wolf cannot catch prey, but a healthy strong wolf can. “Catching prey using 
calories” in this context means calories generating more of themselves. 

A common model for such dynamics of self-reproduction is geometric Brownian 
motion, where x(t) follows the process 

dx = x{fidt + adW), ( 1 ) 

with fi the drift term, a the amplitude of the noise, and dW a Wiener increment. The 
distribution of the exponential growth rates observed in an ensemble of trajectories 
after time T is Gaussian, and the model is an attractor for more complex models that 
exhibit multiplicative growth mi. 

The expectation value (or ensemble average) of (Eq.[^ is easily computed, {dx) = 
{x) ^dt, which describes exponential growth of (x) at a rate equal to the drift term, 

{x) = g,. Naively, one might guess that the growth rate observed in an individual 

trajectory, g{x{T)) = 7^ In will converge to the same value in the long time 

limit limT-j-oo; but this is not the case. Instead, the growth rate observed in a single 
trajectory converges to gt {x) = p, — ^. The inequality of gt and g^ , discussed in the 
context of ergodicity breaking in [ 3 ] , is the aspect of (Eq. that is of interest for the 
evolution of cooperation. 

Having established these properties of (Eq. we now introduce our model of 
cooperation. We start with two non-cooperating entities whose resources follow 
(Eq.© with identical drift and noise amplitude but different realizations of the noise, 
i.e. dxi = Xi{gdt + adWi) and dx2 = X2{gdt + adW2), where dWi and dW2 are 
independent Wiener terms. 


2 


Grow 


Cooperate 



Figure 1: Cooperation dynamics. Cooperators start each time step with equal re¬ 
sources, then they grow independently according to (Eq. , then they cooperate by 
pooling resources and sharing them equally, then the next time step begins. 


Consider a discretized version of (Eq. , such as would be used in a numerical 
simulation. The non-cooperators grow according to 


Axi{t) 


(<) + 


Xi{t + At) = Xi{t) + Axi{t), 


( 2 ) 

(3) 


where are standard normal random variates, ^ Af {0, 1). 

Cooperation works as follows. We imagine that the two previously non-cooperating 
entities, with resources xi{t) and X 2 (t), cooperate to produce two entities, whose re¬ 
sources we label yi{t) and j/ 2 (t) to distinguish them from the non-cooperating case. 
We envisage equal sharing of resources, yi = 2 / 2 , and introduce a cooperation operator, 
0, such that 

xi®X2 = yi+y2- (4) 


In the discrete-time picture, each time step involves a two-phase process. First 
there is a growth phase, analogous to (Eq. [^, in which each cooperator increases its 
resources by 


Ayi{t) = y^{t) 


pAt + aVAt^i 


(5) 


This is followed by a cooperation phase, replacing (Eq. [^, in which resources are 
pooled and shared equally among the cooperators: 


, A^^ yi{t) + Ayi{t) + y 2 {t) + Ay 2 {t) 
yi{t + At) = --- 


( 6 ) 


With this prescription both cooperators and their sum experience the following 
dynamic: 


{Xx 0 X2){t 0 At) 


{Xi 0 X2){t) 



(^^xAt + aVAt^^'^ 


(7) 
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For ease of notation we define 


( 8 ) 


^ _ si + ?2 

^102 - ^ , 

which is another standard Gaussian, ^102 ~ -^( 0 , 1 ). Letting the time increment 
At —>■ 0 we recover an equation of the same form as (Eq. but with a different 
fluctuation amplitude, 

a 

^71 

The expectation values of a non-cooperator, {xi(t)), and a corresponding coop¬ 
erator, (1/1 (t)), are identical. From this perspective there is no incentive for coop¬ 
eration. Worse still, immediately after the growth phase, the better-off entity of 
a cooperating pair, yi(to) > 2/2(to)j say, would increase its expectation value from 
;;i(to)+y2(to) exp(^(t — to)) to 2/1 (to) exp(/r(t — to)) by breaking the cooperation. An 
analysis based on expectation values thus finds that there is no reason reason for co¬ 
operation to arise, and that if it does arise there are good reasons for it to end, i.e. it 
will be fragile. For this reason the observation of widespread cooperation constitutes 
a conundrum. 

The solution of the conundrum comes from considering the time average growth 
rate. The non-cooperating entities grow at (2t(xi) = /r — whereas the cooperating 
unit grows at gt{xi (B x2) = g — and we have 

gt{xi IB X 2 ) > gt{xi) ( 10 ) 

for any non-zero noise amplitude. A larger time-average growth rate is the textbook 
definition of an evolutionary advantage. The effect is illustrated in Fig. by direct 
simulation of (Eq. [|)-(Eq.§and (Eq. 0 . 

Notice the nature of the Monte-Carlo simulation in Eig. No ensemble is con¬ 
structed. Only individual trajectories are simulated and run for a time that is long 
enough for statistically significant features to rise above the noise. This method teases 
out of the dynamics what happens over time. The significance of any observed struc¬ 
ture - its epistemological meaning - is immediately clear: this is what happens over 
time for an individual system (a cell, a person’s wealth, etc.). Simulating an ensem¬ 
ble and averaging over members to remove noise does not tell the same story. The 
resulting features may not emerge over time. They are what happens on average 
in an ensemble, but this may have no bearing on what happens to the individual. 
For instance the pink dashed line in Fig. is the ensemble average of Xi{t), Xi{t), 
and {xi 0 a:2)(t)/2, and it has nothing to do with what happens in the individual 
trajectories over time. 

In our model the advantage of cooperation, and hence the emergence of structure 
is purely a non-linear effect of fluctuations - cooperation reduces the magnitude of 
fluctuations, and over time (though not in expectation) this implies faster growth. 

A simple extension of the model is the inclusion of more cooperators. For n coop- 
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erators, the spurious drift term is so that the time-average growth approaches 

expectation-value growth for large n. When judged on expectation values, the appar¬ 
ent futility of cooperation is unsurprising because expectation values are the result 
for infinitely many cooperators, and adding further cooperators cannot improve on 
this. 

The approach to this upper bound as the number of cooperators increases favours 
the formation of social structure. We may generalise to different drift terms, and 
noise amplitudes, cr^, for different individual entities. Again it is straightforward to see 


dW^ 


102 


( 9 ) 


d{xi 0 X 2 ) = {xi 0 X 2 ) ( gdt 
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Figure 2 : Typical trajectories for two non-cooperating (green) entities and for the 
corresponding cooperating unit (blue). Over time, the noise reduction for the cooper¬ 
ator leads to faster growth. Even without effects of specialisation or the emergence of 
new function, cooperation pays in the long run. The black thin line shows the average 
of the non-cooperating entities. While in the logarithmic vertical scale the average 
traces the more successful trajectory, it is far inferior to the cooperating unit. In a 
very literal mathematical sense the whole, {xi 0 X2){t), is more than the sum of its 
parts, xi{t) + X2(t). The algebra of cooperation is not merely that of summation. 
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whether cooperation is beneficial in the long run for any given entity. An entity whose 
drift term, /ri, is larger than a potential cooperator’s drift term, /i 2 , still benefits from 
cooperation if 

- d < ( 11 ) 

^^ 2 2 8 ^ ' 

Another generalisation is partial cooperation - entities can be assumed to share only 
a proportion of their resources, resembling taxation and redistribution. We discuss 
this in a separate manuscript. 

In reality many other effects contribute to the formation of structure, such as the 
emergence of new function and the possibility of specialisation. An example of new 
function is the ability of relatively small multicellular organisms to swim or funnel 
nutrients towards themselves mi, which is necessary to satisfy nutrient demand for 
relatively smaller reaction surfaces. Examples of specialisation are found in larger 
organisms, with different cell types performing specialised tasks. They are also found 
in many forms of human cooperation, with hrms or individuals becoming proficient 
in specihc tasks. 

The impact of risk reduction on time-average growth suggests that risk man¬ 
agement has a rarely recognised significance. Fluctuation reduction {i.e. good risk 
management) does not merely reduce the likelihood of disaster or the size of up and 
down swings but also it improves the time-average performance of the structure whose 
risks are being managed. In a financial context the value of a portfolio whose risks are 
well managed will not just display smaller fluctuations, but will grow faster in time. 
Similarly, a well-diversified economy will grow faster in the long run than a poorly 
diversified economy. 

How significant or insignihcant the effects of fluctuation-reduction are depends 
on the specific setup, but it is tantalising to see that the simple universal setting of 
multiplicative growth generates structure, i.e. large units of cooperation. 

We have explored here momentous consequences of the difference between and 
gt. A property as mathematically simple and important to our understanding of 
structure, especially observed in economic systems, should be discussed on page 1 
of any textbook on economics, ecology, evolutionary biology. For historical reasons 
this is not the case. The first formal treatments of randomness were motivated by 
gambling problems - in 1654 Fermat and Pascal asked how to split the pot in a fair 
manner for an unfinished game and invented the expectation value [7]. From this 
grew utility theory with Daniel Bernoulli’s treatment of the St. Petersburg gamble in 
1738 [5], which forms the basis of all of modern formal economics, including finance 
and macroeconomics, according to Cochrane . An unbroken conceptual line can be 
drawn from 17th and 18th century probability theory to modern economics. 

The insight that time averages may not be identical to expectation values was only 
reached in the development of statistical mechanics in 19th century physics, where the 
physical nature of expectation values was elucidated as the mean over an ensemble 
of non-interacting systems. The development of ergodic theory in the 20th and 21st 
centuries provided the concepts that reveal the physically relevant nature of stochastic 
processes like (Eq. [^. 

Judging from our experience, these developments were not adopted by mainstream 
economics. Economics was the first scientific discipline to embrace randomness as an 
important descriptor of the physical world. Unfortunately during this trailblazing 
immature mathematical concepts became engrained in the formalism. 

Today, concepts that ignore basic non-linear dynamical effects such as those we 
have described here form the curriculum of economics and are being spread into 
economic policy making. Communicating the inappropriateness of these concepts is 


6 




difficult - the vocabulary required to describe the problem is not that of present-day 
economics. 

It may be a generation-defining challenge to develop an economic formalism that 
takes as its basis the mathematical properties we have discussed here. In the process 
we will learn whether our natural tendency to cooperate, our gut feeling and moral 
sentiment, is in harmony with a careful formal analysis of the issues involved. 
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